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ABSTRACT 

The  optimal  control  model  of  human  response  Is  applied  to  study 
target  tracking  performance  of  an  AAA  system.  The  effects  on  tracking 
error  of  different  target  motions,  l.e.  acceleration  profiles,  are  studied 
via  a covariance  propagation  modeling  approach  and  via  experiment.  Diff- 
erent assumptions  relative  to  the  adaptive  tracking  behavior  of  the  human 
are  explored  along  with  different  schemes  for  Inter-axls  attention  allo- 
cation. The  effects  of  visual  Information  inherent  in  a moving  target 
Image  (e.g.  size,  aspect  angle,  etc.)  are  explored  via  comparison  of 
results  with  a moving  Image  vs.  Image  of  fixed  size  and  shape.  Experi- 
mental tracking  results  are  compared  with  those  predicted  by  the  model. 
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1.1  Project  Background 

The  suggested  use  of  control  theoretic  principles  to  model  human  operator 
response  In  AAA  tracking  tasks  dates  back  to  the  1946  work  of  Tustln  [1].  How- 
ever, It  has  only  been  of  late  that  the  tools  of  modern  control  and  estimation 
theory  have  made  the  modeling  process  a reality  [2-4].  In  recent  studies, 
model  predictions  — generated  via  an  optimal  control  approach  — were  In  ex- 
cellent agreement  with  experimental  ensemble  statistics  of  target  tracking 
error  In  both  the  Vulcan  (VADS)  [2]  and  S60  [3-4]  weapons  systems.  Figures 
1-4  show  typical  model-data  comparisons  for  a stralght-and-level  target  flyby 
against  the  S60  system  [4].  Moreover,  the  quality  of  these  results  was  uni- 
formly consistent  over  a variety  of  (maneuvering)  target  profiles.  Despite 
the  success  of  these  efforts.  It  was  recognized  that  numerous  assumptions 
made  In  the  modeling  process  required  further  justification  and  analysis. 
Moreover,  there  were  facets  of  human  response  In  target  tracking  tasks  not 
adressed  by  the  earlier  efforts.  Accordingly,  AFOSR-supported  research  at 
the  University  of  Connecticut,  and  concomitant  efforts  at  the  Aerospace  Medical 
Research  Laboratory,  WPAFB,  has  sought  to  enlarge  our  understanding  of  human 
Information  processing  and  control  behavior  In  target  tracking.  Among  the 
issues  that  have  been  studied  via  a combined  experimental/analytic  program 
during  our  first  year's  effort  are  the  following: 

1.  Effect  of  target  Image  and  size.  The  experimental  program  reported  in 
Refs.  [3-4]  used  a target  Image  of  fixed  size,  shape  and  aspect  ratio. 

The  present  work  explores  the  added  visual  cues  the  human  may  derive  from 
a realistic  (moving)  target  image. 

2.  Sample-path  simulation  of  huoian  operator  response.  We  have  developed 
and  documented  the  equations  and  neccessary  software  with  which  to  gen- 
erate simulated  time  histories  of  pertinent  variables  In  a target  tracking 
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loop  [8].  Sample  paths  have  been  compared  with  real  AAA  cracking  data. 

The  ensemble  statistics  of  these  model-generated  paths  are  compared  with 
averaged  data  and  analytic  covariance  propagation  results  [9]. 

3.  Effect  of  Attention  Allocation.  The  Cracking  system  of  Refs.  [3-4]  had 
two  operators  for  dual  tasks  of  azimuth  and  elevation  tracking.  As  such, 
Inter-axls  attention  allocation  was  not  of  concern.  VADS  [2]  was  a 
single-operator  system,  and  an  ad-hoc  attentlonal  scheme  was  proposed.  The 
Issues  of  dynamic  attention  allocation  are  studied  further  In  our  work. 

4.  Use  of  Hlgh-order  Derivatives.  All  of  the  past  modeling  efforts  required 

• • «•« 

use  of  either  target  acceleration,  0^,  or  jerk,  6^  by  the  state  estimator/ 
filter.  This  Information  was  used  to  compute  a pseudo -driving  noise,  to 
adaptively  adjust  filter  bandwidth.  We  have  now  developed  a technique  for 
estimating  Che  unknown  (to  the  human)  higher  derivatives  using  the  filter 
Innovations  process. 

5.  "Internal  Model"  Assumptions.  The  choice  of  target  model  In  the  Kalman 
filter  had  received  little  attention  In  previous  efforts.  The  use  of 
polynomial  models  (e.g.  velocity  vs.  acceleration  models),  and  first-order 
Markov  models  have  now  been  explored  In  more  detail  within  an  analytic  context. 

1.2  Experimental  Tracking  Task 

The  Intent  Is  to  focus  our  modeling  efforts  on  Che  human's  Information 
processing  and  control  behavior  without  the  atCendent  complexities  of  high- 
order  system  dynamics.  Accordingly,  we  shall  consider  a simplified  k/s  track- 
ing loop  with  command  Input,  0^-target  angle,  as  shown  In  Fig.  5.  Elevation 
and  azimuth  loops  are  assumed  Identical  In  structure.  This  Is  not  a restrictive 
situation  as  most  tracking  systems  employ  essentially  rate  command  dynamics, 
e.g.  k/s  modified  by  adding  high  frequency  filtering. 


6 « sight  angle 


0 


Fla.  5;  BASIC  TRACKING  LOOP 
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The  basic  loop  equations  are,  with  ■ 6^,  ■ e » tracking  error. 


z(t) 


(1.1) 


where  z(t)  ■ 6^.  Other  forms  for  the  target  representation  (here  given  by 
Xj^  ■ z(t))  will  be  considered  In  the  sequel. 

The  experimental  program  that  we  conducted  used  two  different  trajectories 
0^(.).  A stralght-and-level,  constant  velocity,  aircraft  flyby  was  used  for 
baseline  work  and  for  comparisons  with  similar  on-golng  efforts  at  AMRL.  A 
target  flyby  with  low-bandwidth  random  pitching  was  used  to  enhance  the  effects 
of  any  visual  cues  derived  from  the  target  Image.  For  each  target,  two  sets 
of  experiments  were  conducted  to  study  Image  effects.  In  one  set,  the  target 
was  represented  on  the  CRT  display  as  a triangle  of  fixed  size  and  shape. 

In  the  second  set,  the  target  was  assumed  to  be  a A -shaped  aircraft.  The  Image 
presented  on  the  CRT  was  the  actual  contour  of  the  aircraft  as  would  be  seen 
by  a human  observer.  Thus,  the  Image  appeared  to  rotate,  change  aspect  angle 
'and  grow  In  size  Inversely  with  range. 

Another  set  of  experiments,  using  only  the  basic  flyby  trajectory,  were 
done  to  Isolate  the  effects  of  Inter-axls  attentlonal  allocation.  Azimuth  and 
elevation  axes  were  controlled  separately,  but  with  elevation  and  azimuth 
errors,  respectively,  held  at  zero.  In  this  manner  full  attention  is  available 
for  slngle*axls  control.  This  set  of  single-axis  tasks  was  repeated  with  and 
without  explicit  visual  cues  from  the  target  Image. 

In  all  experiments  the  subjects  tracked  to  minimize  error,  and  were  scored 
using  an  RMS  criterion.  The  data  collected  were  the  time-histories  of  crack- 
ing error,  e(t),  and  human  Input,  u(t).  For  the  same  experimental  condition, 
these  tlne-hlstorles  ware  ensemble  averaged  to  obtain  mean  tracking  error, 
e(t),  and  standard  deviation,  o^(C),  vs.  time.  The  averaging  process  first 


was  done  for  each  subject,  and  then  across  subjects  to  obtain  the  "grand" 
averages.  A complete  description  of  the  experimental  setup  and  procedures 
Is  given  In  Chapter  2.  The  experimental  results  are  plotted  In  Appendix  B. 
1.3  Modeling  Approach 

The  application  of  the  Optimal  Control  Model  [5]  of  human  response  to 
obtain  performance  predictions  is  relatively  straightforward  [2].  The  system 
dynamics  are  given  In  the  requisite  form 


i (t)  - A x (t)  + B u(t)  + F z(t)  (1.2) 

— O —0~V  ~D  “ 

via  Eq.  (1.1).  The  displayed  Information  consists  of  tracking  error  e(t), 
and  hence  also  error  rate  e(t).  In  those  cases  where  there  are  no  target 
Image  cues . Thus , 


y(t)  - C x (t)  + D u(t) 

^ — irk  — ir% 


(1.3) 


The  visual  assumption  In  the  Optimal  Control  Model  (OCM)  Is  that  the  human 
perceives  a delayed  noisy  replica  of  ^(t). 


lp(t)  ■ 2.<t-T)  + Vy(t-T) 

where  each  whlte-gausslan  noise  v^^(t)  has  covariance 
’'‘’vl  2 


(1.4) 


(1.5) 


The  quantity  « .01  is  the  nolae/slgnal  ratio,  f^  Is  the  attention  allo- 
cation to  output  pair  and  Is  the  linearized  describing  function 

gain  of  the  visual/ Indifference  threshold  of  width  + a^.  The  gain  is 


^Slnca  there  is  only  one  Indicator  per  axis,  f^  ■ f^  or  f^  is  the  attention 

to  either  the  azimuth  or  elevation  axis  tracking  task,  as  the  case  may  be. 
We  require  -f  ■ 1. 
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a function  of  the  mean  and  standard  deviation  of  y^(t)  [6].  Figure  6 shows 
the  structure  of  the  Optimal  Control  Model.  The  human's  feedback  control 
strategy  Is  represented  by 


T u + u ■ -L  k (t)  + T V (t) 
n o n u 


(1.6) 


u - jTn“^]  +v^(t) 

u 


(1.6a) 


where  the  "neuro-motor"  time-constant  t = .1  and  v (t)  is  a white  gausslan 

n u 

noise.  In  a slight  departure  from  past  modeling  efforts,  the  covariance 
v^(t)  Is  assumed  to  scale  with  commanded  control  rate  as  opposed  to  commanded 
control.  This  has  been  found  to  give  results  consistent  with  past  steady- 
state  modeling  work,  and  Is  more  appropriate  to  non-statlonary  tasks  (as  here) 
where  large  mean  control  Inputs  are  usual.  Thus, 


V (t)  ■ IT  p E{u  } 
u u c 


(1.7) 


where  P * .01  - .003. 
u 


The  control  gains  [L, ,L  ] ■ [t  ^ L,  t are  selected  to  minimize  the 

■I  ^ n ~ n 

quadratic  cost  functional 


■ ^ '1/ 


^(t)  + g u^(t)]dt 


(1.8) 


l.e.,  to  minimize  mean-squared  tracking  error.  The  control  rate  weighting, 

g is  adjusted  to  give  a value  t » .1  sec.  For  this  system,  g ■ .0004. 

n 

I 

The  state  estimate  x (t)  ■ generated  by  the  cascade  combination 

of  an  (augmented)  Kslman  filter  end  a linear  predictor.  The  filter  equation  Is 


X (t-T)  ■ A x(t-T)  + B u^(t-T)  + C(t-T)  [Xp(t)  - £ i(t-T 


(1.9) 


where 


I 


x(t-T)  - E I x(t-T)  j i (o)  » O _<  t I 
r ' -I  r -1  ' 


A B 

— D — O 


0 , ; B -K  ; c.  D^] 


(1.10) 


and  u (t)  ■ -T  L S (t) , 
c n — o 


The  filter  gain  G(t)  Is 

G(t)  - E(t)  c'  Vy"\t) 

where  ^(t)  Is  generated  from  the  Rlccatl  equation 


• * * 1 

i-A  I + iA  - I£  V (t)cr(t)+  2 

0 V /t 
u n 


(1.11) 


(1.12) 


The  "peeudo-nolse"  ^ is  chosen  such  that  the  filter  adapts  to  the  changing 
characteristics  of  the  Input  signal  z(t).  In  previous  modeling  efforts  [2,4] 
It  was  found  that  choosing  according  to 


^(t)  - F z (t)  F 


(1.13) 


gave  model  predictions  that  accurately  matched  human  response  data,  viz 
Figs.  1-4.  Although  the  agreements  were  excellent.  It  must  be  recognized  that 
the  signal  z(t)  Is  not  "observed"  by  the  human,  and  so  model  modifications  are 
warranted . 

A method  for  estimating  z(t),  or  equivalently  F z(t),  was  developed  In 
the  current  effort.  The  signal  z(t)  Is  what  gives  rise  to  the  ensemble  mean 


statistics  via  the  mean  filtering  error  equation. 


L*  (A-GC)^+F  l(t-T) 


(1.14) 


where  ej(t)  • E{x(t-T)  - x(t-T)}.  The  mean  error  gives  rise  to  a mean  inno- 
vations in  the  Kalman  Filter, 


1 
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(1,15) 

Rewriting  Eq.  (1.14)  In  the  form 

e--A^-Gv  + F z(t-T)  , (1.16) 

a fading  memory,  recursive  least-squares  algorithm  has  been  derived  to  estimate 
z(t-t)  from  the  non-zero  mean  residuals.  The  technique  has  been  remarkably 
successful  In  generating  an  estimate  $(t-T)  that  accurately  "tracks"  z(t-T) 
for  all  target  profiles  considered  to  date.  The  details  of  the  estimation 
scheme  are  presented  in  Section  3.1. 

1.3.1  Model  Application  Process 
Once  the  model  parameters 


'yl-  “ul-  ’»•  *1> 


are  specified,  the  OCM  can  be  used  to  generate  predictions  of  ensemble  sta- 
tistics for  all  pertinent  variables  In  the  tracking  loop.  The  mean  and  co- 
variance  propagation  equations  that  must  be  Integrated  to  obtain  these  results 
are  given  In  full  detail  In  Ref.  [7].  Also  presented  are  the  discretized 
equations  for  computer  Implementation. 

The  selection  of  model  parameters  can  be  a difficult  subprocess  In  general. 
However,  past  research  In  human  response  theory  has  shown  that  typical  parameter 
values  are 

T ■ .15  - .2  sec 

P. 


.08  - .1  sec 


p ^ - -20  dB 

yi 


- -20  to  -25  dB 


n "ul 

and  that  these  values  are  not  dependent  on  the  type  of  dynamics  being  con- 
trolled. Thus,  when  the  OCM  is  applied  to  "match"  target  tracking  data  we 
have  found  It  relatively  easy  to  first  make  nomlnel  predictions  using  a priori 
values,  and  then  fine-tune  using  one  or  more  parameters.  Moreover,  if  one  con- 


siders only  tracking  error  statistics,  changes  In  t,  and  p^^  have  been  found 
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to  produce  very  similar  effects  on  model  predictions:  both  e(t)  and  o (t) 

e 

Increase  with  larger  parameter  values.  Thus  one  can  fix  any  two  of  these 
parameters  and  adjust  the  third.  In  this  effort  we  picked  t ~ .2  sec,  ~ 

-20  dB  (to  reflect  a medium  quality  hand-position  controller),  and  adjusted 
p about  Its  nominal  value. 

y 

The  Identification  of  vlsual/lndlf ference  thresholds  a^  Is  a bit  more 

subtle.  Here  one  looks  for  periods  of  easy  (and  hence  good)  tracking,  where 

|z(t)|  Is  small,  and  then  adjusts  to  match  the  tracking  error  standard 

deviation.  This  Is  possible  since  sensitivity  studies  show  that  the  value  of 

a^  has  little  or  no  effect  on  the  ensemble  mean  error  statistics.  It  Is  also 

possible  to  obtain  estimates  of  a^  from  questionnaire,  or  more  often  by  a simple 

analysis  of  display  gain,  format  and/or  scale  markings.  In  our  work  we  found 

It  necessary  to  use  a small  visual  display  gain  (K . » 1/8) , which  resulted  In 

a 

a threshold  value  of  about  1.5*  on  tracking  error.  In  accordance  with  past 
work,  error  rate  thresholds  are  selected  as  1/2  of  this  value. ^ 

1.4  Overview  of  Model-Data  Comparisons 

Typical  OCM  predictions  of  (ensemble)  mean  tracking  errors  and  standard 
deviations  for  a k/s-type  system  are  shown  In  Figs.  2 and  4.  These  results 
are  for  a stralght-and-level  flyby.  The  mean  errors  arc  quite  symmetric  (or 
antl-symmetrlc)  about  crossover,  with  a structure  that  Is  very  nearly  propor- 
tlonal  to  z(t)  > 0^.  Changes  In  the  basic  model  parameters  (t,  p^} 

produce  a scaling  affect  on  the  magnitude  of  the  mean  error,  but  have  little 
or  no  effect  on  the  Inherent  symnetrlc  structure.  With  these  results  as  back- 
ground, we  give  an  overview  of  the  modeling  efforts  conducted  during  the  first 
year's  resaarch. 

1.4,1  Internal  Model  Studies 

Our  experimentally  obtained  mean  tracking  error  for  a flyby  (no  visual 
further  analysis  of  the  efficacy  of  this  "rule-of-thumb"  la  being  undertaken. 
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Image  cues,  full  aCCendon  to  a single  axis)  Is  shown  In  Fig.  7 . Notice  that 
the  mean  errors  have  the  same  general  form  as  the  corresponding  model  predic- 
tions, but  show  an  asymmetry.  There  Is  relatively  more  lag  prior  to  crossover 
with  less  lead  (overshoot)  after  crossover.  Numerous  attempts  to  reproduce 
this  tracking  characteristic  by  changing  model  parameters,  cost  functional 
weights,  etc.,  have  reached  one  conclusion:  Since  mean  tracking  error  Is 
similar  In  form  to  z(t)  In  Eg.  (1.2),  It  Is  necessary  to  change  the  internal 
target  model  so  as  to  change  z(t).  Accordingly,  we  model  the  target  motion  via 
a first-order  Markov  process 

i^(t)  - -a  x^(t)  + 2(t)  (1.17) 

where  now 

z(t)  - 0^(t)  + a 0^  (1.18) 

The  parameter  a ^ 0 represents,  to  some  extent,  the  "bandwidth"  of  the  signal 
Xj^(t).  The  form  (1.17)  Is  a natural  extension  of  the  earlier  Weiner-process 
model,  with  a ■ 0,  and  Is  examined  In  Section  3.2. 

Model  results  have  shown  that  this  modification  does  Indeed  give  the 
asymmetry  required  In  e(t).  However,  a Is  not  a constant.  In  order  to  match 
data,  and  provide  consistent  modeling  hypotheses,  a must  be  a function  of 
(estimated)  target  acceleration  and  velocity,  plus  the  human's  uncertainty  In 
the  latter.  This  means  that  the  correlation  time  1/a  Is  directly  dependent 
on  target  motion,  but  depends  Indirectly  on  target  visual  cues  and/or  attention 
allocation  requirements.  This  also  Implies  that  changes  in  display  quality 
can  alter  (Indirectly)  tracking  error  structure. 

1.4.2  Velocity  vs.  Acceleration  Models 

The  target  repreaentatlon  x^  ■■  z(t)  la  called  a "velocity"  model.  It  Is 
the  alaplaat  form  of  a general  polynomial  approximation  to  the  target  motion. 
The  next  model  in  the  hierarchy  would  be  an  "acceleration"  modal.  If  let 
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X,  ■ then, 

1 T 2 T 


*1  " ^2 


(1.19a) 


- z(t)  - 0^ 


(1.19b) 


and  with  Xj  ■ e(t)  ■ tracking  error  we  have  the  final  state  equation 

Xj  ■ x^  - u (1.19c) 

f 

This  state-space  representation  Is  In  the  form  of  Eq.  (1.2),  where  F - [010] 

ass 

and  z(t)  ■ 6(t).  If  the  optimal  control  model  Is  applied  to  this  case,  using 

2 I ••• 

W . ■ F z (t)  F , then  the  mean  tracking  error  is  similar  to  0(t).  This  does 

— d — “ 

not  match  the  data.  Horeover  there  Is  no  reason  to  stop  the  polynomial  modeling 

S0 

process  at  O!  A way  out  of  this  dilemma  Is  provided  by  the  scheme  we  have  de- 
veloped for  estimation  of  £(t).  If  Eq.  (1.19a-b)  is  rewritten  as 


Xj^  - x^  + Zj^(t) 


(1.20a) 


(1.20b) 


we  can  then  estimate,  via  the  Innovations  technique,  the  vector  process  £(t)“ 

t 

[Zl,  z^]  . This  gives  the  model  the  ability  to  ascribe  uncertainty  to  both 
target  velocity  and  acceleration.  In  actuality  Zj^(t)  ■ 0.  But  when  estimated 
we  find 


Zl(t)  “ e^(t)  and  Z2(t)  - 0 


(1.21) 


Therefore,  writing  the  target  motion  as  a higher-order  model  has  no  effect 

on  the  OCM  predictions,  as  should  be  the  case.  In  retrospect  this  result  Is 

• • 

due  to  the  fact  that  no  information  concerning  6(t)  Is  contained  In  the  obser- 
vations y^  " •!  y2  " *•  Hence,  It  Is  unreasonable  to  expect  any  estimation  of 

sa 

0 in  the  Kalman  filter.  Of  course  this  would  not  be  the  case  If  the  human 


were  presented  or  could  derive,  target  acceleration  cues. 
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1.4.3  Target  Image  Effects 

Experimental  results  with  and  without  the  target  Image  showed  that 
1)  mean  tracking  errors  were  always  reduced,  but  2)  error  standard  deviations 
had  mixed  changes  when  the  human  tracked  a realistic  Image.  It  also  appears 
that  the  structural  form  of  e(t)  tends  to  become  slightly  more  symmetric  when 
the  visual  cues  are  added. 

Several  different  assumptions  for  modeling  the  added  Information  are 
considered  In  Section  3.4.  It  Is  assumed  that  the  visual  cues  can  modify 
Indifference  thresholds  and  can  provide  Information  relative  to  target  angular 

4 •• 

velocity  6(t),  and  possibly  angular  acceleration,  6(t).  These  can  be  brought 
Into  the  OCM  structure  by  defining  additional  "observations". 

y3(t)  - 0^(t)  ; y^(t)  - *0^(t)  (1.22) 

Note  that  In  order  to  write  the  observations  ^ In  the  form  of  Eq.  (1.3),  when 
y^(t)  Is  Included,  we  must  use  an  acceleration  model  for  the  target,  Eq.  (1.20a-b). 
Thus,  y2(t)  - Xj^(t)  and  y^(t)  - . 

We  have  addressed  the  problem  of  Intra-axls  attention  allocation  (using 
a steady-state  model) , and  have  found  that  0 Information  has  a small  effect  on 
performance,  whereas  (0,0)  Information  gives  a large  Improvement  In  performance. 
With  Intra-axls  attention  allocation  considered,  a 50-50  split  In  attention 
between  (e,e)  and  (0,0)  was  found  to  be  best.  Running  the  OCM  for  the  tracking 
task  with  the  expanded  Information  base,  and  the  acceleration  model^,  gave 
predictions  of  mean  tracking  error  that  did  not  adequately  match  the  data. 

The  structural  form  of  a(t)  differed  substantially  from  the  data,  and  the 
error  magnitudes  were  much  too  small.  This  leads  us  to  conclude  that  little 
or  no  useful  acceleration  Information  Is  contained  in  the  target  Image.  Our 

^Mote  that  estimates  of  and  are  now  generated,  i.e.  22^^)  ^ 
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present  assumption  is  that  the  image  does  provide  additional  velocity  infor- 
mation, 9^.  This  does  not  alter  the  structural  form  of  e(t),  yet  provides 
the  potential  for  enhanced  error  rate  information. 

1.4.4  Inter-axis  Attentional  Allocation 

As  expected,  the  experimental  results  showed  that  single-axis  tracking 
errors  are  less  than  their  counterpart  two-axis  errors.  The  OCM  Includes 
attention  allocation  via  a modification  of  the  observation  noise  covariance. 

It  further  presupposes  that  the  human  chooses  the  attentions  f^  to  minimize 

it 

the  cost  functional  J(u  ,f).  The  problem  of  optimizing  the  measurement  sub- 
system with  respect  to  f^  has  been  solved,  but  only  for  steady-state  (stationary) 
manual  control  tasks  [10].  If  one  is  to  model  the  results  of  the  target  tracking 
experiments,  it  is  necessary  to  solve  the  dynamic  attentional  allocation  problem. 
This  is  a very  difficult  requirement. 

For  a two-axis  tracking  task  it  can  be  shown  that 


J(u*,f)»i  f [L  r (t)  l’  + L Z„(t)  l']  dt  + ...  (1.23) 

-TyeAeeEe 

0 

where  T is  the  time  Interval,  L are  "equivalent”  gains  and  E (E  ) is  the 

6 A L 

azimuth  (elevation)  axis  filter  Rlccatl  solution.  E(t)  is  a function  of  V (t), 

y 

and  thus  of  f(t),  via  Eq.  (1.5).  An  ad-hoc  attention  allocation  scheme  was 
proposed  in  Ref.  [2],  under  the  assumption  that  "optimal"  attention  was  pro- 

f 

portlonal  to  L E L . The  result  was 


f^(t)  - (1  + R)  * 

fj(t)  - 1 - «,(t) 


L L 
e E e 

L E^  L' 

e A e 


(1.24) 

(1.25) 


In  Section  3.3  It  Is  shown  that  this  simple  model  gives  reasonable  results  in 
reproducing  Che  attention  va.  no  attention  trends  in  the  data.  This  brings 
up  the  question  of  whether  development  of  a more  complex  dynamic  attention 


r* 

— i 
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model  Is  warranted.  The  question  may  be  answered  in  part  by  comparing  model 

predictions  of  tracking  errors  obtained  with  somewhat  different,  but  plausible, 

ad'hoc  attention  allocation  schemes.  Accordingly,  the  ratio  R In  Eq.  (1.24) 

was  replaced  with  R**  where  we  consider  p“l  (as  before),  p-2  and  p««> . The 

latter  case  corresponds  to  0-1,  or  time-shared  behavior  between  the  two  axes. 

Each  of  these  3 schemes  resulted  In  somewhat  different  time  histories  for 

f (t)  and  f_(c).  However,  the  various  tracking  error  statistics  showed  little 
A E 

differences  among  the  3 schemes.  Our  conclusion  is  that  almost  any  plausible 
inter-axls  attention  allocation  scheme  will  give  rise  to  very  similar  ensemble 
error  statistics.  Our  preference  Is  P“2  since  E has  a natural  dependence  on 
/t  via  the  Rlccatl  equation  (1.12). 

1.4.5  Monte-Carlo  Modeling  Results 

A major  effort  during  the  first  year  of  the  grant  was  the  implementation 
of  the  OCM  equations  for  Monte-Carlo,  or  sample  path,  simulation  to  generate 
time  histories  of  tracking  error,  control  Input,  etc.,  in  response  to  any 
given  target  trajectory.  Thus,  the  model  mimics  the  input-output  response 
of  the  human,  complete  with  random  noise  generators  to  produce  the  operator's 
Internal  observation  and  motor  noises.  The  three  basic  equations  that  are 
simulated  are: 

1)  Kalman  Filter 

^ (t-T)  - A *(t-T)  + B u^(t-T)  + G(t)  [yp(t)  - C x(t-T)j  (1.26) 

2)  Predictor 

t 

y*  B u^(a)  do 

t-T 


lt(t)  ■ e^^  ll(t-T)  + 


(1.27) 
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3)  Controller 

u(t)  + u(t)  - u^(t)  + v^(t)  (1.28) 

u (t)  - -L  ic(t) 
c 

In  addition,  the  covariance  equation  for  Z must  be  Integrated  forward  In  time. 

Using  a Honte-Carlo  model  one  can  study  performance  measures  not  readily 
available  from  the  averaged  ensemble  statistics,  such  as 

1.  Oscillation  frequency  content  In  the  responses 

2.  Autocorrelation  and  cross-correlation  functions 

3.  Spectral  characteristics  over  time  windows 

4.  Effects  of  transient  phenomena 

5.  General  time-domain  oriented  Items. 

Theoretically,  the  statistics  of  the  ensemble  of  such  model-generated  waveforms 
will  agree  with  the  covariance  propagation  results  obtained  directly.  Moreover, 
it  is  possible  to  study  (numerically)  the  smoothing  process  In  forming  ensend>le 
averages, 

N 

e„(t)-^  £ e,(t)  (1.29) 

n " 1-1  ^ 


to  determine  characteristics  of  e (t)  vs  N as  N-m°. 

N 

The  model  has  been  applied  to  a k/s  azimuth  axis  tracking  task  with  a 
stralght-and-level  aircraft  flyby.  The  model  results  are  compared  with  Alr- 
Forcs  (AMRL)  experimental  data  gathered  on  the  S60  System.  Fig. 8 shows 
typical  time  histories  of  tracking  error  e(t)  generated  by  both  a human  and 
the  model.  They  are  quite  similar  in  form,  demonstrating  oscillatory  behavior 
that  is  not  evident  from  the  predicted  ensemble  statistics  of  Fig.  2 alone. 

As  ws  build  an  ensembla,  the  oscillations  tend  to  be  smeared-out  as  the  wave- 
forms are  averaged  via  Eq.  (1.29).  This  process  is  seen  in  Fig.  9 where 
data  and  model  ensemble  means  are  presented  for  N*15  sample  runs. 

As  we  expect  •(£)  ■*»<•  variance  (t)  -►  o^(t) 

N 


-T 


where 
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a (t)  - 


ei(t)  - 


2 


is 


(1.30) 


This  is  essentially  true.  Fig. 10  shows  the  ensemble  statistics  of  e„(t) 

N 

and  a (t)  for  N-100.  Compare  these  with  e(t)  and  a (t)  in  Fig.  2.  We  see 

!»  _ t ^ 

that  • and  that  the  standard  deviations  agree  very  well  except 

for  a small  region  near  crossover.  This  "mismatch"  is  due  in  large  part  to 
temporal  averaging  of  the  observation  noise  covariance  in  the  model  implemen- 
tation [8]. 

1 . 5 Summary 

The  first  year's  work  has  been  directed  towards  analyzing  the  effects  of 
human  limitations  on  target  tracking  performance  in  a basic  rate  command  system, 
by  means  of  a combined  analytic-experimental  program.  Our  efforts  to-date  have 
focused  primarily  on  the  development  of  a human-centered  model  for  target  motion, 
and  transient  analysis/sample  path  simulation.  An  experimental  facility  for 
studying  human  operator  tracking  has  been  established  in  the  Electrical  Engi- 
neering and  Computer  Science  department  at  UConn.  With  this  facility,  and 
concomitant  OCM  analytic  efforts  we  have  studied  effects  of  visual  cues  and 
inter-ax  Is  attentlonal  allocation.  Data-model  comparisons  have  been  used 
to  Isolate  plausible  model  assumptions  and  hypotheses.  Further  details  on 
our  results  are  given  in  Chapters  2 and  3,  and  in  the  Appendices. 

Research  is  presently  continuing  at  the  University  of  Connecticut  to 
examine  further  the  various  Issues  that  have  impact  on  human  tracking  perfor- 
mance. Target  tracking  expcrlMnts  with  interrupted  (i.e.  blanked)  visual 

For  Gaussian  distributions  we  expect  |e„(t)  - e(t)|  < — a (t)  with  95Z 

**  ~ *ia 

probability.  " " 
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information  have  been  completed,  but  the  results  have  yet  to  be  analyzed. 

We  will  continue  sensitivity  analyses  of  model  results,  and  refine  our  para- 
meter tuning  methods.  Further  experimental/analytic  work  will  focus  on  op- 
timizing the  man-machine  Interface  via  selected  system/display  modifications. 
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II . EXPERIMENTAL  PROGRAM 

In  the  first  year  of  the  program,  efforts  were  directed  towards  esta- 
blishing an  experimental  facility  that  would  enable  us  to  study  human  operator 
performance  in  simulated  man-machine  systems.  Our  goal  was  to  generate  the 
data  needed  to  both  refine  and  tune  the  optimal-control  model,  and  to  test 
that  model's  predictive  accuracy.  The  effort  concentrated  on  the  simultaneous 
development  of  computer-controlled  dynamic  simulation  and  data-acqulsltlon 
capabilities  and  Involved  five  phases: 

1.  Hardware  acquisition,  configuration  and  interfacing, 

2.  Software  development, 

3.  Experimental  design  and  shakedown  runs, 

4.  Final  experiments,  and 

5.  Data  reduction  and  analysis. 

These  are  detailed  below. 

2 . 1 Hardware 

The  heart  of  our  experimental  facility  is  a DEC  PDP  11/20  computer  with 
dual  floppy  disks;  to  this  were  added  later  a high-speed  DEC-pack  disk  drive 
and  a magnetic  tape  unit.  An  oscilloscope  with  an  eight-inch  CRT  was  connected 
to  the  computer’s  processor,  via  two  digital-to-analog  converters,  to  provide 
our  display  medium.  The  10  bit  D/A  converters  enable  horizontal  and  vertical 
deflections  of  the  oscilloscope's  beam  to  any  desired  point  on  the  screen  with 
a 1024  X 1024  grid  resolution. 

Sampling  the  subjects’  responses  to  the  displayed  stimulus  required  a 
spring-centered,  two-axis  Joystick  to  be  wired  into  the  computer's  processor 
via  analog-to-digital  converters.  The  A/D's  map  the  joystick  deflections  in 
the  two  axes  to  digital  quantities  with  a resolution  of  10  bits  (one  part  in 
1024) . 
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2.2  Software 

The  operating  system  of  the  PDF  11/20  was  expanded  to  run  FORTRAN  programs, 
and  handle  the  peripheral  devices.  Extensive  software  has  been  written  to: 

1.  simulate  arbitrary  controlled-element  dynamics  of  the  tracking  system, 

2.  generate  simulated  target  trajectories  with  arbitrary  attitude, 
altitude  and  cross-over  range, 

3.  collect  data  In  real  time,  storing  It  In  memory  buffers,  and 

4.  shipping  the  data  to  files  on  mass-storage  peripherals  for  off-line 

processing.  ■ 

Our  repertoire  of  target  trajectories  currently  ranges  from  stralght-and- 
level  flybys  to  some  quite  complex  profiles.  For  the  more  complex  trajec- 
tories, the  aircraft  bank  and/or  pitch  angles  are  computed  as  the  sum  of  up 
to  five  sine  waves  of  Independent  amplitudes,  periods  and  phase  angles.^ 

The  output  data  files  consist  of  the  sampled  tlme-hlstorles  of  the 
tracking  errors  In  azimuth  and  elevation,  and  of  the  joystick  control  Inputs 
In  these  axes.  The  sampling  time  T^  " .025  sec.  Additional  subroutines  were 
written  to: 

1.  retrieve  the  output  data  files, 

2.  perform  preliminary  sequential  analyses  on  the  raw  data,  such  as 
ensemble  mean,  variance,  temporal  RMS  error  scores, 

3.  compute  ensemble  t-tests  to  detect  statistically  significant 
differences  among  the  experimental  conditions  (at  any  one  of  five 
levels  of  significance),  and 

4.  to  dlaplay  the  results  In  graphic  form  on  the  CRT  screen  and/or 
to  produce  hard  copy  on  an  X-Y  plotter. 

It  was  necessary  to  write  special  purpose  software  to  display  the  sim- 
ulated target  on  the  screen  and  to  sample  the  subject's  control  input  signal. 

The  standard  DEC-supplied  asynchronous  interrupt-handling  routines  (LPSLIB) 

^This  is  not  a restriction  — any  time  history  of  ^(t)  and/or  Y(t)  may  be  used. 
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proved  much  too  slow  for  real-time  simulation  of  hlgh-bandwldth  dynamics. 

Even  under  the  most  favorable  circumstances  It  could  not  effect  sampling  rates 
In  excess  of  10/second.  Writing  our  own  software  enabled  us,  at  the  outset, 
to  sample  consistently  at  20/second;  further  refinements  and  optimization 
Increased  the  rate  to  40/second  for  both  sampling  the  Input  signal  and  re- 
freshing the  display.  This  rate  of  AO/second  was  used  throughout  the  formal 
experimental  runs. 

2.3  Pre-Experlmental  Detail 

A major  goal  of  our  first-year  experimental  program  was  to  provide  a data 


base  for  refining  the  Optimal  Control  Model  of  human  response,  with  emphasis 

on  the  human  Information  processing  submodel.  In  order  to  avoid  the  attendant 

complexities  of  hlgh-order  system  dynamics,  a rate-command  system  was  simulated 

with  transfer  function  G (Figure  11)  equal  to  K /s- 

^ sample  *^sample 


sight 

angle 


Fig,  n.  STRUCTURE  OF  SIMULATION  LOOP 

The  rate-command  gain  K was  set  at  1.70  as  this  value  was  judged  "most 

P 

comfortable"  by  subjects  during  the  shakedown  runs.  The  display  gain  was 
set  to  0.106.  At  this  setting  a straight-and-level  pass  (to  be  described 
shortly)  fits  exactly  within  one  screen-width  (8  Inches) . 

2.3.1  Forcing  Functions 

The  forcing  function  0.p(t)  was  the  position  of  a delta-shaped  target 
Image  during  a fly-by  trajectory.  We  have  the  capability  to  specify  the  cross- 


over  range  XOR,  initial  target  altitude  lA  and  its  attitude  (Figures  12  & 13) . 

The  target's  velocity  is  cotsputed  from  these  to  produce,  in  a straight-and- 
level  flyby,  a symnetric  trajectory  subtending  a 2 x 84.26”  angle  (Figure  14), 
Independent  of  the  cross-over  range.  Therefore,  all  straight-and-level  flybys 
effect  identical  profiles  of  angular  velocity  and  angular  acceleration  (6^  and 
respectively)  regardless  of  cross-over  range.  The  only  range  cue  is  the 
size  of  the  target  image. 

We  used  three  trajectories  (labeled  "A",  "B"  and  "C")  which  were  defined 
as  follows  (see  Figure  12): 

Trajectory  "A":  lA  ••  50  ft.,  XOR  ■ 50  ft.,  6 “ a (S  & L fly  by) 

Trajectory  "B":  lA  - 2000  ft.,  XOR  - 2000  ft . , 6 - a (S  & L f ly  by) 

Trajectory  "C":  lA  - 50  ft.,  XOR  ■ 100  ft.,  8 i*  a;  the  target  follows  a 
path  in  the  vertical  plane  with  its  flight  path  angle 
Y defined  by 

Y(t)  • sin  ^ ^ (f^  ^ 

0.3  sin  (~  t + 0.375)  radians 
where  T is  the  total  time  for  a run. 

Trajectories  "A"  and  "B"  looked  identical  — that  is,  their  forcing  functions 
e^(t)  were  identical  — except  that  the  target  image  was  much  smaller  for 
trajectory  "B"  (due  to  its  further  range)  and  looked  like  a dot  on  our  CRT 
screen. 

2.3.2  Subjects  and  Training 

Some  thirty  candidates  were  screened  as  potential  subjects  for  our  ex- 
periments. Of  these,  about  half  were  then  selected  to  participate  In  the 
experimental  program,  baaed  on  their  ability,  attitude  and  enthusiasm.  These 
subjects  were  then  trained  on  a variety  of  simulated  trajectories.  Including 
the  three  flybys  described  above,  until  their  performance  met  a preset  crlter- 
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Ion  (RMS  cracking  error  consistently  below  5®  In  both  azimuth  and  elevation). 

We  chose  our  subjects  from  among  the  University's  undergraduate  students, 
graduate  students  and  staff  for  the  first  two  experiments  (to  be  described  In 
the  next  section)  and  from  among  Air  Force  ROTC  candidates  for  subsequent 
experiments.  All  our  subjects  were  male.  Their  ages  ranged  from  20  to  53 
years  for  the  seven  subjects  in  the  first  group,  with  a mean  of  31;  the  ages 
of  the  ROTC  group  ranged  from  20  to  23  years  with  mean  age  of  21.  There  was 
one  pilot,  one  subject  with  sharpshooting  experience  and  one  person  with  AAA 
experience  in  the  first  group.  In  the  ROTC  group  there  were  three  pilots, 
two  sharpshooters  and  two  subjects  with  some  experience  as  radar  operators. 

The  training  and  familiarization  runs  were  intended  to  ensure  data  homogeneity 
in  spite  of  these  diverse  backgrounds  by  bringing  all  subjects  to  a common 
level  of  proficiency  before  the  formal  experimental  runs.  In  addition,  the 
data  which  were  obtained  from  the  individual  subjects  in  the  course  of  the  formal 
experiments  were  tested  for  outlyers,  which  were  then  eliminated  from  further 
analysis.  This  procedure  will  be  discussed  in  more  detail  in  the  section  on 
Data  Reduction  and  Analysis. 

2.4  Experimental  Design 
2.4.1  Visual  vs.  No  Visual  Cues 

Our  first  experiment  was  designed  to  detect  possible  effects  on  tracking 
errors  of  direct  observations  of  target  visual  cues  such  as  target  size  and 
aspect  ratio.  A 3 x 2 factorial  design  was  utilized,  so  chat  each  of  the  seven 
subjects  tracked  three  different  trajectories  ("A",  "B"  and  "C").  Each  tra- 
jectory was  tracked  both  under  ccnditions  of  "visual  cues  present"  (i.e.,  a 
realistic  target  image)  and  of  "no  visual  cues"  (the  target  image  retained 
a fixed  sice  and  shape).  These  six  conditions  were  repeated  by  each  subject 
from  three  to  twelve  times,  depending  on  the  subject's  availability,  in  random- 
ized blocks  of  18  runs  each. 
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Fig.  15a:  TARGET  IMAGE  WITH  VISUAL  CUES  SIMULATED 
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The  display  presented  a symbolic  cross-hairs  centered  on  the  CRT  screen 
(Fig.  15a)  and  a triangular  target.  Under  the  "visual  cues  present"  condition 
the  triangular  image  simulated  a delta  planform.  It  varied  in  size  and  shape 
as  the  simulated  target's  range,  bearing  and  altitude  varied  (see  Appendix  A 
for  details).  Under  the  "no  visual  cues"  condition,  the  triangular  target 
followed  Identical  trajectories  but  the  triangle  retained  a fixed  size  and 
aspect  ratio  throughout  the  run  (Fig.  15b). 

Each  experimental  run  lasted  25.575  seconds.  At  a sampling  rate  of  40/ 
second  we  thus  collected  1024  datum  points  per  run  for  each  variable  of  Interest. 
The  ensemble  means  and  standard  deviations  of  the  tracking  errors  In  azimuth 
and  In  elevation  are  grouped  In  Appendix  B. 

We  have  also  been  collaborating  with  Ms.  Sandra  Hart  of  the  Biotechnology 
Division  of  NASA-Ames  Research  Center,  who  Is  studying  possible  correlation 
between  subjective  time  estimation  and  mental  workload  associated  with  manual 
tracking.  In  the  framework  of  this  first  experiment  we  recorded  at  the  end 
of  each  run  the  subjects'  estimate  of  the  duration  of  that  run.  Even  though 
all  runs  were  of  Identical  durations  the  subjects'  estimates  varied  over  a 
wide  range.  Subsequent  analysis  of  the  data,  however,  failed  to  reveal  any 
correlation  between  the  time  estimates  and  the  difficulty  of  the  particular 
trajectory  ot  the  tracking  performance.  (Surprisingly,  the  means  and  variances 
of  the  time  estimates  under  the  different  conditions  come  remarkably  close 
to  each  other. )^  We  are  continuing  to  collaborate  with  Ms.  Hart  and  will  In- 
clude further  results  In  next  year's  program  plan. 

2.4.2  Inter-axls  Attentions!  Allocation 

We  attempted  to  control  the  unknown  effects  of  Inter-axls  attentlon- 

^It  may  be  that  Intersubject  variability  masks  any  differences  due  to  workload. 





35 


sharing  In  our  second  set  of  runs.  This  experiment  was  of  a 2 x 2 factorial 
design,  with  each  subject  tracking  two  trajectories  ("A"  and  "B")  In  azimuth 
alone  (with  the  error  In  elevation  clamped  at  zero)  and  In  elevation  alone 
(with  zero  azimuth  error).  Each  of  the  three  subjects  repeated  the  experiment 
6 times  in  a randomized  order,  for  a total  of  18  runs  for  each  experimental 
condition. 

As  mentioned  earlier,  trajectories  "A"  and  "B"  were  equivalent  with  re- 
spect to  the  forcing  function  6^  and  differed  only  by  the  range  to  the  target 
and  hence,  by  the  size  of  the  displayed  target.  Within  the  bounds  imposed 
by  the  resolution  of  our  equipment,  the  target  Image  In  trajectory  "B"  re- 
sembled a dot  and  hence  trajectories  "A"  and  "B"  represented  equivalent  flybys, 
with  visual  cues  and  without  visual  cues,  respectively.  During  the  data-reduc- 
tion  phase  that  followed  the  first  experiment,  we  had  determined  that,  from  the 

standpoint  of  visual  cues,  a target  represented  by  a dimensionless  dot  and 
(• 

a tar^t  represented  by  a triangle  of  fixed  size  and  shape  were  not  different 
statife^lca^y . 

^?he  results  of  this  set  of  runs  are  also  grouped  In  Appendix  B. 

e 

2.4.3  Interrupted  Observationa  ,, 

A third  experiment  was  begun  during  the  last  months  of  the  first  year. 

In  this  set  of  runs  we  attempted  to  Investigate  some  transient  and  target- 
acquisition  modes  via  Interrupted  observations.  We  are  now  In  the  data 
analysis  phase  of  this  study. 

2.5  Data  Reduction  and  Analysis  Methods 

Pour  variables  were  sampled  and  stored  during  each  formal  run:  the  In- 
stantaneous tracking  errors  In  azimuth  and  elevation,  and  the  control  stick 
positions  In  these  two  axes.  At  a sampling  rats  of  40/second,  each  25.575- 
second  run  produced  1024  datum  points  for  each  of  these  four  variables.  In 
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addition,  some  header  Information,  such  as  forcing  function,  subject  Iden- 
tification symbol,  date  and  time  of  run,  etc.,  was  recorded. 

The  first  step  In  analyzing  this  vast  amount  of  data  was  to  aggregate, 
l.e.,  to  compute  and  store  the  polnt-by-polnt  ensemble  means  and  mean-squares. 
We  utilized  a sequential  approach  to  the  computation,  by  which  the  mean 
of  the  j-th  point  (0<j_<1024)  of  k+1  runs  was  computed  from  mj^  by 


"ilti  ■ ("J  • I'  'mi  )'  ” 


(2.1) 


where  z^..  Is  the  value  of  the  j-th  point  In  the  (k+l)-ch  run,  and  m^  • 0, 
k+1  o 

1-1,  2 ...  1024. 

The  mean-square  was  computed  similarly  from  q^  by 


*k+l 


(ij  ■ k * / (k«) 


(2.2) 


and  the  unbiased  estimate  of  the  variance,  v^,  was  then  found  from 


(2.3) 


Utilizing  the  ensemble  means  and  variances,  two-sided  t-tests  could  be 
performed  (with  the  appropriate  number  of  degrees  cf  freedom)  to  test  the  null 
hypothesis  of  equality  of  the  means.  We  first  tested  the  assumption  that  our 
subjects  came  from  a homogeneous  population.  If  they  did,  then  the  mean  track- 
ing error  of  each  subject  should  not  be  statistically  different  from  the  mean 
tracking  error  of  all  the  subjects  combined.  For  each  subject  we  compared 
the  mean  tracking  errors  In  azimuth  and  elevation  to  the  corresponding  mean 
tracking  error  of  all  the  subjects  combined  for  the  same  experimental  conditions 
(trajectory,  visual  cues/no  visual  cues).  We  found  that  the  mean  tracking  errors 
of  one  of  the  seven  subjects  were  significantly  different  In  the  crossover 
region  (P^  < 0.01).  This  subject's  data  was  removed  from  the  combined  mean. 
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and  the  averaging  procesa  was  then  repeated  with  the  data  of  the  remaining  six 
subjects.  The  data  obtained  from  the  one  outlying  subject  was  not  used  In  any 
of  the  subsequent  analyses. 

Plots  of  the  summarized  data  are  grouped  In  Appendix  B.  As  expected, 
the  availability  of  visual  cues  (target  Image's  size  and  shape)  effected 
smaller  tracking  errors  (P^  < 0.05)  and  error  variances.  Unexpected,  however, 
were  some  characteristics  of  the  data,  such  as 

1.  the  asymmetry  In  the  tracking  error  profile  before  and  after  crossover, 
with  a tendency  to  lag  prior  to  crossover, 

2.  the  slight  lagging  tendency  during  the  first  5 seconds  of  the  run, 

3.  the  smaller  variance  associated  with  the  tracking  error  In  elevation 
without  visual  cues  (trajectory  C)  than  with  visual  cues  (Figures 

B6  vs.  B12). 

4.  the  large  (~1*)  standard  deviations  In  the  tracking  errors  during 
periods  of  good  mean  tracking. 

The  last  point  has  been  attributed  to  the  choice  of  small  display  gain, 

'1/9,  which  In  turn,  resulted  In  large  vlsual/lndlf ference  thresholds  for  the 

subjects.  Thresholds  vary  inversely  with  display  gain.^  In  previous  studies, 

visual  thresholds  used  in  the  OCM  were  In  the  order  of  .15-. 2".  Thus,  we 

might  expect  values  for  a^  1. 5-2.0".  An  analysis  of  the  display  Image/ 

resolution  gives  comparable  numbers:  For  example,  the  angle  between  the  center 

of  the  "crosshairs"  and  the  first  dot  Is  B * 4.5".  W^en  we  lack  an  explicit 

2 

zero  reference  point,  the  OCM  adds  an  observation  noise  V - .OliiB  . It  can 
be  shotm  that  this  effect  Is  alowst  equivalent  to  a threshold  of  value  6/3 
(This  corresponds  to  a "middle-third"  Indifference  region).  Finally,  the  min- 
imal quanta  of  display  resolution  Is  168/1024  ■ .16".  With  a spot  of  light 
smearing  over  10-15  quanta,  a 1. 5-2.0*  threshold  value  Is  to  be  expected. 

Indeed,  OCN-data  matching  gave  position  threshold  vslucs  > 1.5*. 

^See  also  Section  1.3.1. 
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III.  ANALYTIC  MODELING 

This  chapter  describes  Che  various  modifications  and  extensions  that 
were  made  to  the  OCM  during  the  analytic  phase  of  the  project.  These  Include 
adaptive  tracking  of  target  acceleration,  methods  for  modeling  visual  cues 
and  atcentlonal  allocation,  and  use  of  generalized  first-order  aircraft  motion 
models.  Model  predictions  of  tracking  error  statistics  are  given  for  compar- 
ison with  Che  experimental  results  of  Appendix  B. 

3.1  Adaptive  Tracking  Problem 

A welghted-least-square  technique  Is  proposed  for  estimating  higher  deriv- 
ative target  Information  from  the  OCM  Kalman  filter  residuals  process.  The 
results  have  application  In  areas  beyond  human  operator  modeling  In  systems 
with  non-random  Inputs.  Some  of  these  areas  are: 

* Compensation  of  modeling  errors  caused  by  linearization  of  non- 
linear systems 

* Design  of  adaptive  filters  to  determine  the  path  of  a maneuvering 
target 

* Estimation  of  unknown,  time-varying  mean  and  variance  of  a random  Input 
disturbance 

* Detection  of  sudden  changes  In  Che  state  of  a system  with  application  to 
failure  detection 

3.1.1  Problem  Background 

The  relevant  discretized  equations  that  describe  Che  OCM  In  non-statlonary 
systems  are  given  In  Ref.  [7  ].  For  notational  simplicity  In  the  subsequent 
development  It  Is  assumed  that  N ~ r/d  ■ 0.  This  Is  not  a theoretical  re- 
striction as  the  Kalman  filter/estimator  does  not  involve  state  prediction. 

The  (augmented)  state  equation  of  the  system  is  given  by^ 

We  follow  the  notation  and  definitions  of  Ref.  (7  ]. 
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Vl  “ ♦k  \ ^ \ “c.k  ^ "k  ''k  ^ \ 


(3.1) 


where  Is  a deterministic  input  that  represents  the  target  motion.  It  is 

assumed  that  z,  is  unknown  to  the  human, 
k 

The  Kalman  filter  generates  p^^,  the  (a  priori)  estimate  of  Xj^,  from 
the  observations 


’'pk  • S \ 'k 


(3.2) 


The  estimation  error  e^^  ■ x^^  - Pj^  Is  given  by 


'k+1 

or,  equivalently  by 


\ % - *k “k \ *\\*  \ \ 


"k+l 


e,  + E,  w,  + F,  z.  - ♦ G.  V. 
kk  kk  kk  k kk 


(3.3a) 


(3.3b) 


where  Gj^  is  the  filter  gain  and  ♦ ■ ♦(1-GC)  is  the  closed-loop  filter  matrix. 
The  innovations  process  Is 


^^pk  - Vk 


^k\  ^ \ 


(3.4) 


When  the  Kalman  filter  is  optimal,  is  a zero-mean  white  noise  sequence. 
However  an  Input  Zj^  renders  Vj^  non-white.  This  fact  will  be  exploited  to 
generate  z^,  an  estimate  of 

I 

In  the  OCM  a pseudo-noise  matrix  P.  W F is  added  to  the  filter 

K Q f K K 

Rlccatl  equation  to  account  for  the  human' a uncertainty  In  the  signal  z^.  It 


has  been  shown  that  choosing 

“d.k ' 


[¥  'k.  J ‘ 


T » 1 
Cl 


(3.5) 


approximately  minimizes  the  msan-square  filtering  error,  and  results  In  model 
predictions  that  match  data  quite  well  (see  Figs.  1-4).  Eq.  (3.S)  has  physical 
appeal,  as  the  uncertainty  In  target  estimation,  (and  hence  the  Kalman  filter 
bandwidth),  Increase  as  target  motion  z^  Increases.  However,  there  Is  an 
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inconsistency  in  this  model:  was  assumed  to  be  unknown  to  the  human! 

A way  out  of  this  dilemma  is  the  obvious  modification  of  Eq.  (3.5)  to  replace 
z^  with  an  on-line  computed  estimate  z^^. 

3.1.2  Adaptive  Estimation  Algorithm 

Eqs.  (3. 3-3. 4)  are  the  basic  set  of  equations  for  generating  z^^.  Taking 
expectations,  noting  that  w =»0,  v • 0 and  z = z , yields 

K K iC  K 


Vi  ■ *k  \ \ \ 


V ■ c e 
k k k 


(3.6a) 

(3.7) 


From  "measurements"  of  v^  (the  signal  is  readily  available  in  the  Kalman 
filter),  we.  will  obtain  an  estimate  of  z^^.  Note  that  this  problem  is  tanta- 
mount to  designing  the  inverse  system  to  Eq.  (3. 6-3. 7). 


In  actual  Implementation  an  estimate  of  would  be  obtained  by  on-line 
filtering  (l.e.,  averaging)  of  v^.  We  would  thus  obtain  an  estimate  of 
^k  ^k*  ^ denotes  the  temporal  mean,  from 


'’u  ■ C,  e.  + v, 
k k k k 


(3.8)- 


where  v,  is  filtered  white  observation  noise, 
k 

Solving  Eqs.  (3.6a-3.7)  for  assuming  yields 

k-1 

\ - C E VCk-l,  1)  F z 
1-0  ^ 


(3.9) 


where 


t(k-i.i) . V, 


i+1 


; '•'(J.j)  - I 


(3.10) 


If  1*^1^  denotes  the  estimate  of  z^  given  all  the  measurements  (v^,  ...,  v^} 


then  our  best  cstiMte  of  v la 

k 


k-1 

\ Z ’(k-l.i)  Fj 


(3.11) 
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The  estimate*  obtained  via  a weighted-least-squares  method  to 

minimize  the  criterion  (at  step  k) , 


u - v 
j j 


(3.12) 


where  Is  an  NY  by  N\  diagonal  matrix  used  to  give  relative  weighting  to 

the  importance  of  each  measurement  v ; 1*1,...,  NY^.  The  constant  0<6<1 

J » 1 

Is  a fading  memory  factor  used  to  place  greater  emphasis  on  the  more  recent 
data.  This  Is  particularly  helpful  when  z varies  rapidly. 

The  minimization  of  Eq.  (3.12),  Is  a formidable  problem  as  It  requires 
the  recomputation  (l.e.  smoothing)  of  past  estimates  2^.  Thus  storage  and 
CPU  time  increase  with  k.  Since  there  Is  no  evidence  of  such  behavior  In  human 
operator  tracking,  we  simplify  the  ULS  problem  by  replacing  the  smoothed  estim- 
ate Eq.  (3.11)  with  the  filtered  estimate  minimization 

of  with  respect  to  the  on-line  computable  quantity  ^^/l+l  " *l 
least-squares  theory.  Define  the  "effective”  measurement  y^  as 


•k— ^ 

^ - V - C,  , X,  y(k-2,l)  F,  2, 
k k k k-1  1 1 


(3.13) 


Thus,  by  construction. 


^k  “ ^k  ^k-1  *k-l 


- H.  z.  , + e. 
k k-1  k 


(3.14) 


where  Cj^  Is  the  residual  Vj^  - and  Is  NZ  by  NY. 

The  estimate  (obtained  at  step  k)  Is  generated  recursively  according 


if  Rj  ■ cov  obtain  a minimum  variance  estimator,  assuming  white 

residual  sequence.  Plausible  choices  are  ^J*^* 
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where 


*k-l  “ *k-2  ^k  ^^k  ■ ”k  \-2^ 


^ \ «k  ^“k  \ \ ^ 


v-1  „’ 


(3.15) 


(3.16) 


(3.17) 


^k  “ \ \ <\  ®k  \ ^ \>  »k  \ 

^k+1  " ^ ®k  propagation) 


and  ■ 10  I Is  the  initial  condition.  The  update  Eq.  (3.17)  can  also  be 
written  in  the  more  computationally  stable  Joseph's  form. 


s.  - (I  - r,  H, ) s.  (I  - r,  H, ) + r,  a,  r. 
k kkk  kk  kkk 


(3.17a) 


The  least  squares  algorithm  operates  most  efficiently  when  the  NY  "measurements" 
^k  1’  ^k  NY  processed  through  the  update  sequence  Eqs.  (3.15)-(3.17) 

one  at  a time.  Dropping  the  time  index,  for  simplicity,  the  pertinent  re- 
cursive replacements  are,  for  i ■ 1,...,  NY 
Y - S h^  (h|  S h^  + r^)~^ 

I 

S (I  - Yh^)S  (or  use  Joseph's  form) 

2 ♦ 8 + Y(y^  j S) 

If  we  start  with  z ■ Zj^  2»  ® with  2 ■»  2j^  and  S ■ S^.  It  is 

worth  noting  that  if  we  define  I > 6S,  the  Equations  (3.16-3.17)  remain  the 
same  but  with  I replacing  S and  6R|^  replacing 

The  above  algorithm  for  8 is  very  simple  to  Implement  and  requires  minimal 
extra  storage.  In  computing  y^^  via  Eq.  (3.13)  note  that  the  summation  term 
is  2^,  i.e.  the  result  of  passing  1 £ k-2  through  the  "system"  Eq.  (3.6a) 
with  initial  condition  e^  ■ 0.  Thus,  y^^  is  easily  obtained  recursively  by 
using 


®k-l  “ *k-2  *k-2  ^k-2  ‘k-2 


(3.18a) 
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and 


■ % ♦k-l  ®k-l 


(3.19a) 


3.1.3  Modifications  and  Extensions 

The  WLS  algorithm,  as  derived,  was  based  upon  Eq.  (3.3a)  which  Involves 
the  closed-loop  matrix  4^.  An  alternate  formulation  Is  based  on  using  Eq.  (3.3b), 
Involving  the  open-loop  system  matrix  Taking  expectations  of  Eq.  (3.3b) 

yields  ' 


k+1 


k k 


+ F 


k k 


- "k  “k 


(3.6b) 


where  the  "measurements"  are  known.  If  we  use  Eq.  (3.6b)  in  lieu  of  Eq. 
(3.6a)  In  estimating  we  find  that  all  of  the  previous  equations  remain 

exactly  as  before,  except  that  the  estimated  mean  and  "measurement"  Eqs. 
(3.18a)-(3.19a)  become,  respectively 


k-1  k-2  k-2  k-2  k-2  k-2  k-2  k-2 


'k  k k ’^k-l  k-1  k-1  k k-1  k-l 


(3.18b) 

(3.19b) 


We  have  found  that  these  equations  produce  somewhat  better  estimates  of  i than 
do  their  closed-loop  counterparts.  Fig.  (16)  shows  open-vs-closed  loop  results 

for  the  k/s  tracking  system  with  a stralght-and-level  flyby.  The  estimation 

• • ^ 

of  Is  excellent;  model  predictions  of  e and  (not  shown)  are 

virtually  Identical  for  these  cases. 

Another  Bx>dlf icatlon  to  the  basic  algorithm  gathers  more  Information 
before  estimating.  Of  course  this  Introduces  a lag  Into  the  process.  We 
assume  that  Is  constant  over  the  last  i ^ 1 time  steps,  l.e. 

*k-l  “ *k-2  " • • • " *k-l 

and  we  estimate  2^^  This  modifies  Bqs.  (3.13-3.14)  to 
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where 


k-1-1 

y.  ■ V.  - C,  2^  VCk-t,!)  F, 
k k k i 1 


m V - c ^ ♦ ...♦  e 

k k k-1  k-2  k-Jl  k-t 


e • e + F z 

k~i  k-l-i,  k-i-1  k-l-i  k-l-i 


(3.20) 


(3.21) 


and  Eq.  (3.14)  becomes 


■ k-1  “I 

Z C nk-l.i)  F U + 
Li-k-A  ij  K i. 


(3.22) 


”k  *k-l  ‘^k 


In  this  latter  case  the  matrix  H,  will  become  better  conditioned  as  A Is  In- 

k 

creased. 

In  many  situations,  such  as  In  an  aircraft  subject  to  turbulence,  the 
human  does  not  know  a priori  which  states  of  the  system  are  affected  by 
Therefore,  It  Is  necessary  to  extend  the  estimation  scheme  to  allow  for  z to 
affect  any  state  (or  a subset  of  states  such  as  those  associated  with  the  target 

f 

motion).  This  Is  possible  by  setting  F ■ I,  and  Hj^  = In  the  algorithm. 

We  now  will  estimate  a full  NX-dlmenslonal  vector  z,  and  construct  the  Kalman 
pseudo-noise  matrix  via 


«d.k  - 


^ci  *2 
6 ®k,l 


The  modifications  to  this  scheme  when  z,  is  assumed  to  affect  a subset  of  states 

k 

is  trivial.  Application  of  this  method  has  been  made  to  study  the  utility 

f 

of  higher-order  target  models  In  k/s  tracking.  Use  of  an  "acceleration" 
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submodel  for  the  target  motion  gives  a system  model 
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z 

2(0 

= e(t) 

Application  of  the  estimation  scheme  gave 


z^(t)  = 0(t) 


Z2(t)  “ 0 


so  that  we  get  the  same  results  as  with  the  basic  "velocity"  model!  This  Is 
because 


Ck  f,.  " 
k k 


0 0 
1 0 


l.e.,  does  not  enter  Into  y.  However,  these  same  results  would  not  be  true 
If  an  1>1  step  delayed  estimation  is  used  as  In  Eqs.  (3.20)-(3.22) . In  this 
case  the  WLS  formulation  Is  quite  poorly  conditioned,  and  the  scheme  diverges, 

Zj^  . The  problem  Is  that  the  continuous  CF  is  not  of  full  rank.  If  we  set 
F*I,  allowing  uncertainty  on  all  states,  the  model  predictions  of  e(t)  and 
Og(t)  agree  with  the  basic  "velocity"  model.  We  conclude  that  to  expect  mean- 
ingful results  from  an  "acceleration"  model,  must  be  Included  within  the 

human's  observation  set  • This  Is  discussed  further  In  Section  3.4. 

When  NZ  < NY  the  matrix  Is  usually  of  rank  NZ.  In  this  case  the 
estlowites  of  z^  are  relatively  Insensitive  to  the  fading  memory  factor  8 over 
a wide  range.  For  our  k/s  tracking  system  with  NZ>1  this  range  was  .1-.99. 
However,  when  NZ  ■ NX  >>  NY  there  is  a lower  limit  to  6 below  which  the  decrease 
in  is  offset  by  the  Increase  1/8,  resulting  in  instability.  For  our  k/s 
system,  this  limit  8^^^  * *85.  Instability  of  z^  can  sometimes  be  avoided  by 
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using  Eqs.  (3.20-3.22),  which  assume  constancy  of  over  an  interval,  to 
obtain  augmented  measurements. 

When  the  innovations  sequence  is  filtered  temporally,  in  an  on-line 

manner  to  obtain  v , 

-6/t 

= b + (1-b)  ; b = e *"  (3.23) 

it  is  recommended  that  a test  be  performed  to  determine  whether  the  computed 
V is  statistically  different  from  zero.  If  v is  white,  v,  is  a Gaussian 

K K K 

process  with 


Cov[v  ] 
k 


(3.24) 


1 

I 


Thus,  a t-test  can  be  performed  on  each  component  of  Vj^  (using  this  a priori 
covariance),  thereby  effecting  a probabalistic  editing  of  Preliminary 

work,  using  a covariance  propagation  model  to  study  the  ensemble  characteristics 
of  Eqs.  (3. 23)-(3. 24) , has  shown  the  following: 


I 


1.  Model  predictions  are  not  very  sensitive  to  the  time  constant  over 
the  range  0. 1-1.0.  This  is  due  in  part  to  the  use  of  overall  ensemble 
statistics  in  Eq.  (3.23). 

2.  Probabalistic  editing  gives  results  that  are  similar  to  those  obtained 

using  Eqs.  (3.16)-(3. 17)  with  l.e.  uncertain  measurements 

are  discounted. 

3.  With  no  probabalistic  editing,  filtering  v^^  gives  (on  the  ensemble 
average)  model  predictions  that  are  similar  to  filtering  the  estimate 

obtained  via  Eq.  (3.15). 

On  the  basis  of  our  limited  experience  to  date,  it  appears  that  editing  is 
advantageous  and  will  give  Improved  model-data  comparisons.  We  expect  to 


1 1 
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study  this  process  in  more  detail,  using  both  covariance  propagation  and  Monte- 
Carlo  models.  Investigating  several  different  (but  related)  schemes  for  apply- 
ing the  editing  feature. 

Alternate  methods  for  estimating  and/or  W^  have  been  investigated  in 
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the  course  of  our  work.  Two  methods  estimate  from  the  non-zero-mean  property 

of  the  suboptlmal  Kalman  filter  Innovations.  A third  method  represents  z^ 

by  an  "equivalent"  white  noise,  and  then  estimates  W by  using  Innovation 

d 

correlations  with  a WLS  algorithm.  The  last  method  requires  excessive  compu- 
tations, whereas  the  first  two  methods  are  quite  ad-hoc  In  nature.  None  of 
these  other  schemes  have  been  Implemented,  due  In  part,  to  the  excellent  per- 
formance of  the  method  we  are  now  using.  A description  of  these  alternate 
methods,  along  with  a brief  review  of  relevant  adaptive  estimation  literature, 
la  given  In  Ref.  [13]. 

3.2  Modeling  Asymmetries  In  Tracking  Errors 

The  predictions  of  ensemble  error  statistics  using  the  OCM  are  shown  In 
Figs.  17-18,  for  azimuth  and  elevation  axes,  respectively.  As  discussed  pre- 
viously, the  a priori  model  parameters  are 

T ■ .2  P ■ -20  db  on  all  observations 

y 

T ■ .1  P ■ “20  db 

n u 

The  Indifference  thresholds  were  a^  * 1.5°  for  position  errors  and  1.5/2  for 
their  rates.  These  results  correspond  to  the  case  of  full  attentlonal  allocation, 
l.e. , 


and  where  no  model  modifications  have  been  Introduced  for  target  Image  effects. 
Thus,  the  predictions  of  Figs.  17  and  18  should  be  compared  with  the  no  visual 
cues,  full  attention  experimental  results  of  Figs.  B1  and  B2,  respectively. 

The  model-data  agreements  are  reasonably  good  — being  generally  within 
1 experimental  standard  deviation.  However,  our  concerns  In  this  study  are 
to  understand  the  reasons  behind  the  mismatches,  and  to  modify  the  OCM 
accordingly.  Major  points  we  note  from  the  comparisons  are  the  following: 
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1.  The  predicted  e(t)  are  essentially  symmetric,  much  as  previous  results 
using  the  OCM  have  shown.  But  the  data  show  an  apymmetry  towards  more 
lag  prior  to  crossover. 

2.  Predicted  mean  errors  are  somewhat  smaller  than  the  experimental  re- 
sults, especially  for  elevation  axis.  The  max-to-mln  spread  for 
azimuth  is  -6°  vs.  7-8®  for  data.  For  elevation  it  Is  -3®  vs.  5-6® 
for  data. 

3.  Predicted  standard  deviations  agree  quite  closely  with  experimental 
results  In  general  form,  for  azimuth  has  a broader  peak  than  that 
for  elevation  In  both  model  and  data. 

We  do  not  find  any  major  concern  in  Items  2 and  3,  which  deal  primarily  with 

the  relative  magnitude  of  the  model  vs.  data  results.  Sensitivity  analyses 

have  shown  that  such  data-modcl  mismatches  can  be  adjusted  via  tuning  of  one 

or  more  key  parameters.  For  example,  an  Increase  In  (dB)^  will  Impart  a 

scaling  Increase  to  both  e(t)  and  o (t),  with  a greater  effect  being  seen  In 

e 

o (t).  On  the  other  hand,  the  correlation  time  t In  Eq.  (3.5)  has  little 
e c 

effect  on  e(t);  but  a + factor  of  2 In  t has  about  the  same  effect  on  a (t) 

— c e 

as  a + 1 dB  change  in  p^.  Thus,  to  "match"  data  one  could  adjust  to  match 
e(t),  and  then  adjust  t to  match  a (t) . As  It  was  not  our  objective  to  con- 

C 6 

tinually  fine-tune  the  results  (once  the  possibility  was  established),  we 
merely  fixed  p^  ■ -20  dB  and  ■ 1 sec  to  explore  the  more  challenging  first 
point  of  model  structure.  Follow-on  efforts  will  deal  more  with  parameter 
Identification  schemes. 

The  asymmetry  In  mean  tracking  errors  is  notlcable  In  most  all  of  our 
data  runs.  Similar  trends  also  occured  In  some  recent  2-axis  Q-23  system 
experiments  at  AMRL.  However,  these  trends  were  not  readily  apparent  In 
earlier  S60  data  (different  system,  display,  etc.),  as  shown  In  Figs.  1 and  3. 


^Changes  In  p^,  p^  and  t have  similar  effects  on  error  statistics.  We  thus 

keep  T and  p fixed  and  vary  only  p . 

u y 


I 

I 


We  feel  that  this  asynmetry  phenomenon  Is  statistically  significant,  and  have 
spent  considerable  effort  to  find  a suitable  explanation. 
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It  is  not  believed  that  use  of  a priori  knowledge  of  the  target  plays 

a role.  If  it  did,  the  relative  spread  |e  ~ e ^ I would  have  been  much 

' max  min 

smaller  than  the  OCM  [11]  — not  merely  shifted.  In  cooperation  with  colleagues 
at  AMRL,  various  modifications  to  the  OCM  were  tested  in  order  to  Induce  an 

asymmetry  in  OCM  results,  e.g. 

1.  changing  basic  parameters,  e.g.  t , p , etc., 

n.  y 2 

2.  adding  cost  functional  weights  to  e(t)  and  control  magnitude,  u (t), 

3.  filtering  the  estimated  signal  z(t)'  before  using  it  to  form  W., 

a 

4.  filtering  the  residual  process  as  in  Eq.  (3.23), 

5.  using  an  "acceleration"  model  for  target  motion. 

As  noted  earlier,  the  last  item  circles  back  to  a velocity  model  when  we  require 
estimation  of  z(t)  ■ impose  z(t)  - z(t)  - [6,0]  without 

estimation,  mean  tracking  errors  (which  resemble  z or  z)  have  a different  form 
structurally  than  the  data.  The  other  items  were  found  to  give  little  struc- 
tural change  to  the  model  results;  errors  generally  Increased  or  decreased 
uniformly.  Any  asymmetries  that  developed  were  generally  in  the  wrong  direction 
— l.e.  towards  higher  post-crossover  overshoot.  It  was  believed  that  items 
3 or  4 would  Introduce  the  sought-for  lagging  tendency.  They  had  little 

effect  on  e(t),  but  did  reduce  lo  (t)|  slightly. 

e 

The  only  model  modification  that  was  found  to  have  a structural  Impact 
on  e(t)  was  a generalized  Markov  model  for  the  target  motion,  viz. 

Xj^  • -a  + z(t)  (3.25) 


with  o When  Included  with  the  system  dynamics  we  have 
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] 


0 


y(t) 


x(t)  + 


u(t) 


(3.27) 


The  "lag"  1/a  Introduces  the  asymmetric  lagging  tendency  observed  in  the  data. 
However  o cannot  simply  be  a constant.  Figure  19  shows  that  the  lagging  ten- 
dency would  persist  well  past  crossover  — a trend  not  seen  in  the  data.  We 

* •*  A 

conclude  that  a must  be  a function  of  Zf  etc.,  in  order  to  match  data. 

Indeed,  a(t)  can  be  Interpreted  as  a "local"  bandwidth,  so  that  an  o(t)  of 
the  form 


ci(t) 


E{xJ} 

E{xJ} 


-1 

sec 


(3.28) 


could  be  expected.  We  assume  that  a ^ 0. 

Several  different  ad-hoc  combinations  of  target-related  variables  were 
simulated  for  o(t),  with  varying  degrees  of  success.  The  question  of  whether 
an  "optimal"  value  of  a exists  was  studied  using  Eq.  (3.25).  The  Kalman  filter 
Implementation  for  this  equation  assumes 

x^(t)  - -a  Xj^(t)  + {(t)  (3.29) 

• **  2 

where  t(t)  Is  a whlte-nolse  with  covariance  W.  - t (a  9„  + e„)  . Neglecting 

O c T T 

the  other  states,  and  assuming  an  "observation"  of  x^(t)  with  measurement 
2 2 

noise  ■ c E{xj^(t)},  a Kalman  filter  would  estimate  x^^  with  covariance 
error 

- -20  - eJ/V^  (3.30) 

Aasumlng 

M * T e{02}  + T e{0^} 

d c c 

we  see  Chat  there  exists  a velue  of  o that  minimizes  — the  locel  rate  of 
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increase  of  the  estlnatlon  uncertainty.  Setting  9E^/9a  ■>  0 gives 

a*  - E{e^}  (3.31) 

For  small  a,  E,  = /V  W and  we  see  that  Eq.  (3.31)  Is  quite  similar  to  Eq. 

i 1 U 

(3.28).  An  alternate  approach  "solves"  Eq.  (3.30)  for  its  steady-state  (frozen- 

point)  value.  Finding  the  a that  minimizes  E gives  results  that  are  quite 

ss 

similar  to  Eq.  (3.31). 

Motivated  by  the  above  approximate  analysis,  we  have  selected  a(t)  over 


the  Interval  [k,k+l]  according  to  the  uncertainty  in 

^’^,11  -1 

k 57.3 


(3.32) 


The  scaling  of  with  E^  is  particulerly  appealing.  It  Implies  that  there 


I should  be  more  lag  (asymnetry)  with  higher  uncertainties,  as  for  example  when 

I observation  noises  increase  or  target  motions  become  more  rapid.  It  also 

* corroborates  subject's  comments  that  they  "felt  more  comfortable  when  lagging". 

I The  quantity  is  the  model's  anticipated  spread  in  the  x^  estimate,  i.e., 

Xj(t)  c + C]  with  99%  probability. 

I Note  that  with  oi(t)  now  time-varying,  the  system  matrix  A > A(t).  This 

. means  that  * ■ exp(Ad)  and  the  feedback  gain  on  x^(t)  must  be  recomputed 

^ each  time  a changes.  Fortunately,  the  only  a-dependent  terms  in  are 

{ ; *21  ■ (1  - e"“®)  / a 
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^2  "-7 


(3.33b) 


(3.33c) 


where  r ■ g (g  » control-rate  weighting).  For  r=.02  (corresponding  to  t *.1), 

n 

a simple  approximation  to  the  discrete  gain  equivalent  to  Eq.  (3.33a)  Is 
- 8.765  + .75a  ; a i 2 


so  that  does  not  depend  strongly  on  a. 

The  model  predictions  with  a generated  according  to  Eq.  (3.32)  are  shown 
In  Figs.  20  and  21.  Clearly  this  gives  a closer  faclmlle  to  data  than  did 
the  previous  model  plots. 

3.3  Attention  Allocation  Submodel 

When  a human  Is  required  to  track  azimuth  and  elevation  axes  simultaneously, 
there  must  be  a mechanism  by  which  attention  Is  allocated  between  the  two  par- 
allel tasks.  This  Issue  of  Interaxls  attentlonal  allocation  Is  not  of  concern 
In  a dual  operator  system  (such  S60)  where  each  operator  controls  but  one 
axis.  In  a single  operator  system  tracking  performance  degrades,  as  workload 

Increases.  If  we  define  f (f  ) as  the  fractional  attention  allocation  to 

A E 

azimuth  (elevation)  tracking  with 

f^  - 1.0, 


our  objective  Is  to  model  the  allocation  process  via  prediction  of  f^  vs.  time. 

As  Indicated  In  Section  1.4.4,  a model  for  obtaining  optimal  attention 
allocation  has  been  derived  for  stationary  single-axis  tracking  tasks.  In 
such  cases,  the  total  cost  functional  Is  given  by 

J(u*,f)  ■ I + terms  Independent  of  Z (3.34) 

where  are  "squivalsnt"  gains 

- g**  L e^^  (3.35) 


T* 
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and  r Is  the  steady-state  error  covariance  matrix  which  satisfies  the  Riccatl 
equation.  The  matrix  Z depends  on  the  observation  noise  covariance  V , and 

y 

thus  in  turn  on  the  attentional  allocations  to  each  position-velocity 
observation  pair  via  Eq.  (1.5).  For  two-axis  tracking  in  a non-statlonary 
context,  J(u*,f)  is  given  approximately  by  Eq.  (1.23).  In  this  case  the  op- 
timal choice  of  f.(t)  and  f„(t)  is  not  straightforward,  involving  the  solution 

A C< 

of  a complex  non-linear  dynamic  programming  problem. 

A simpler,  suboptimal,  approach  has  been  followed  in  our  work.  Borrowing 
from  the  techniques  of  Ref.  [2],  we  attempt  to  find  f^(t)  and  fg(t)  so  as  to 
minimize  at  every  time  Instant  the  Integrand  of  Eq.  (1.23), 


L 2:.(t)  l'  + L Z_(t)  l’ 
e A e e E e 


(3.36) 


The  matrix  E.(t)  decreases  with  Increases  in  f,(t).  If  we  assume  Z • 1/f, 
A A 

I 

then  the  "optimal"  attention  allocation  should  be  proportional  to 

Under  the  constraint  f + f ■ 1,  we  then  have 

A E 


f (t)  - (1  + R) 

A 


-1 


L EL 

fg(t)  - 1 - f^(t)  ; R - 

e A e 


(3.37) 

(3.38) 


This  was  the  model  suggested  in  Ref.  [2]. 

Depending  on  the  assumed  relationship  between  E(t)  and  f(t),  other  models 

are  possible.  For  example,  the  choice  E « l/i^  is  motivated  by  the 
' -1 

EC  V CE  term  In  the  Riccatl  equation.  VHien  V is  small  (l.e.  good  obser- 

y y 

vatlons),  this  term  becomes  dominant.  Under  this  assumption,  the  "optimal" 

• 2 

attention  allocation  is  proportional  to  (L^EL^)  . A third,  plausible  approach 
to  model  the  attentional  subprocess  Is  to  assume  that  the  human  Is  a single 
channel  processor.  Internally  switching  full  attention  between  the  axes  In 


■-  ... 


r* 
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turn.  Thus  £.  and  f will  be  either  0 or  1,  depending  on  the  relation 
A E 

I I 

L E.  L « L L . 
e A e > e E e 

All  three  of  these  models  may  be  combined  In  the  same  mathematical 
framework  by  replacing  the  ratlc  R In  Eq.  (3.28)  with  R**  where  p«l,2,  or*. 

The  model  predictions  of  ensemble  error  statistics  are  given  In  Figs.  22-23 
(p“l)  and  Figs.  24-25  (p“2) . The  corresponding  time  histories  of 
shown  In  Figs.  26a  and  b,  respectively.  As  can  be  seen,  the  ensemble  error 
results  and  the  attentlonal  time  histories  are  virtually  Identical,  with  an 
elevation  vs.  azimuth  attention  split  approximately  50-50  during  the  "good 
tracking"  phases. 

The  results  for  p"  are  shown  In  Figs.  27-28;  the  time  history  of  f.(t) 

A 

Is  not  shown.  f,(t)  was  found  to  switch  rapidly  between  0 and  1 with  a period 
of  .1  to  .3  sec.  During  the  "good-tracking"  phases  approximately  equal  time 
was  spent  on  elevation  and  azimuth,  further  corroborating  the  results  of  Fig. 
26b.  In  the  Immediate  pre-crossover  Interval  most  time  was  spent  on  azimuth; 
the  reverse  was  found  In  the  Immediate  post-crossover  region.  The  error 
statistics  e(t),  o^(t)  are  quite  similar  to  those  of  p=l  or  2,  especially 
for  azimuth  tracking.  Some  differences  are  noted  In  elevation  mean  tracking 
Immediately  before  crossover,  and  In  standard  deviations  during  crossover, 
with  slightly  more  oscillatory  behavior  noted. 

The  beelc  trend  exhibited  by  all  three  schemes,  over  the  full  attentlonal 
results.  Is  that  both  error  mean  and  especially  standard  deviations  Increase. 
Relatively  little  change  Is  seen  In  e(c)  with  max-to-mln  excursions  increasing 
from  5*  to  6*  for  azimuth  and  from  2%“  to  3%*  for  elevation.  The  corresponding 


'in  steady-state  cases  It  has  been  sho%m  that,  under  rapid  switching,  single 
channel  and  parallel  processing  models  are  equivalent  [12]. 
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experimental  results  (attention  sharing,  no  visual  cues)  are  shown  In  Figs. 

B3-B4  for  the  50  x 50  stralght-and-level  flyby.  The  comparisons  of  model-vs- 

data  results  are  quite  encouraging.  The  qualitative  trends  In  the  data  have 

been  very  well  captured  by  the  model  predictions;  quantitative  % Increases 

In  e and  a also  agree  closely, 
e 

We  are  somewhat  puzzled  by  the  steady-state  mean  error  offset  (.5°-. 6°) 

In  the  model  predictions.  A brief  numerical  analysis  Indicates  that  It  arises 
In  part  from  the  large  model  thresholds,  and  Is  compounded  by  the  Increase  In 
due  to  attention  sharing.  There  have  also  been  numerical  approximations 
made  In  the  time-varying  a case  that  Introduce  propagation  errors.  Allowing 
estimation  of  z(t)  on  all  states  should  help  reduce  this  offset. 

At  this  point  there  Is  no  statistically  significant  differences  among 

f 

the  three'Kp*l>2,<»)  attentlonal  allocation  schemes  when  compared  with  data. 

This  is  especially  true  for  p“l  or  2.  Our  current  preference  is  towards  the 
p-2  model,  which  treats  the  human  operator  as  a parallel  channel  Information 
processor.  In  order  to  distinguish  further  between  the  p*2  vs  p"”  cases  It 
will  be  advisable  In  future  efforts  to: 

1.  examine  model  vs.  data  results  for  control  stick  input  signals, 
searching  for  any  piecewlse-constant  control  trends, 

2.  determine  whether  the  pseudo-noise  should  be  modeled  as  a function 
of  f^(t), 

3.  examine  Interactions  between  probaballstlc  editing  schemes  (Section 
3.1.3)  and  attentlonal  allocation. 

A 

Under  the  selection  p“2  the  model  predictions  of  e and  for  trajectory 

C (the  random  pitching  target)  are  given  in  Figs.  29  and  30.  The  corresponding 
experimental  results  are  shown  In  Figs.  B5-B6,  respectively.  The  comparisons 
ere  excellent,  lending  further  credence  to  the  OCM  modifications  thus  far 
introduced  to  treat  target  tracking  and  human  information  processing  behavior. 


ndard  oevution 

S,  PITCHING  TARGET,  SHARED  AHH..  NO  VISUAL  CUES 

- j 
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3.4  Modeling  Target  Visual  Cues 

A set  of  experiments  was  conducted  to  explore  the  effects  of  visual 
cues,  both  with  and  without  the  presence  of  Inter-axls  attentlonal  allocation 
requirements.  The  three  experiments  of  concern  are: 

1.  Stralght-and-level  pass  with  full  attention  to  either  azimuth  or 
elevation,  (see  Figs.  B7-B8) 

2.  Stralght-and-level  pass  with  attention  sharing  (see  Fig.  B9-10) 

3.  Random  pitching  trajectory  with  attention  sharing  (see  Figs.  Bll-12) . 

Our  model  development  work  focuses  on  Item  1,  since  this  experiment  Is  not 
complicated  doubly  by  the  attentlonal  allocation  subprocess.  The  model  can 
then  be  used  to  predict  the  results  of  the  more  complex  cases  2 and  3.  The 
Initial  assumption  regarding  the  visual  cues  Is  that  the  target  image  provides 
the  human  with  enhanced  Information  relative  to  the  target  motion.  In  the 
OCM,  the  only  target-related  variables  are  6 and  9.  Thus,  we  have  investi- 
gated the  hypotheses  that  the  Image  provides  explicit  (relative)  target  velocity 
and/or  velocity  plus  acceleration  cues. 

3.4.1  Potential  Use  of  Target  Acceleration  Cues 

It  is  first  assumed  that  a human  can  derive  both  velocity  and  acceleration 
cues  from  the  target  Image..  The  rationale  behind  this  assumption  Is  that 
target  velocity  In  azimuth  Is  related  to  the  target's  aspect  angle  and 
relative  heading  angle.  In  elevation,  6.^  Is  related  to  observed  pitch  angle. 
Thus,  assuming  Implicitly  derived  rate  Information  by  the  human,  we  obtain  the 
two  additional  "observations" 
y^M  - 

y^M  - 

In  order  to  Include  this  position-velocity  pair  within  the  OCM  It  Is  necessary 
to  go  to  an  acceleration  model,  Eq.  (1.19),  with  observations 
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-1 
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I 

0 

(3.39) 


This  Is  true  for  both  azimuth  and  elevation  axes. 

By  adding  a second  set  of  Information  to  each  axis,  the  problem  of  Intra- 
axis attention  allocation  between  (e,e)  and  (6,6)  must  be  addressed.  While 
there  are  potential  arguements  for  assuming  no  Interference  between  the  Image 
being  tracked  and  the  crosshairs,  our  initial  work  assumes  Interference  to 
determine  the  relative  Importance  of  Image  cues.  This  was  done  using  a 
steady-state  analysis  for  the  system 


-110 
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1 

o 

1 

0-10 

X + 

0 

u + 

1 

10  0 

-1 

0 

— 

(3.40) 


where  w(t)  Is  a white  N(0,1)  noise.  This  equation  corresponds  to  a filtered 
2 

l/(s+l)  random  target  velocity.  The  observation  set  Is  the  same  as  Eq.  (3.39), 
except  that 

- 6^  - [-1  1 0Jx+{0]u 

Three  attentlonal  allocation  cases  were  considered 

1.  Full  attention  to  (e,e),  i.e.  ^3'"^4"^' 

2.  No  attentlonal  Interference,  f^^f^^f^^f^"!. 

3.  Attention  optimization  with  f^^  + f^  ■ 1.,  ^3*^4* 

The  results  are  shown  In  Table  1,  using  the  nominal  OCH  parameter  values. 
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Case 

No. 

3J 

3J 

3J 

3J 

■ ^^4 

J 

1 

1.0 

0.0 

.19 

.38 

1.1 

5.5 

.0156 

2 

1.0 

1.0 

.05 

.07 

.03 

.08 

.0062 

3 

.54 



.46 

.24 

.26 

.14 

.35 

.0088 



Table  1.  ATTENTION  ALLOCATION  RESULTS 


As  can  be  seen,  the  Introduction  of  (6,6)  Information  has  a great  effect  on 

reducing  tracking  errors.  The  relatively  large  gradients  3J/3fj^  for  1-3,4 

in  case  1 evidences  this  fact.  When  we  allow  optimization  there  is  roughly 

» « • 

a 50:50  split  between  (e,e)  and  (6,6),  with  a large  (~40%)  decrease  in  cost 
J(u*,f).  The  differences  between  cases  2 and  3 show  the  effects  of  non-inter- 
ference. But  clearly,  the  more  dramatic  effect  is  between  cases  1 and  3. 

The  OCM  was  exercised  under  the  hypothesis  of  the  observations  Eq.  (3.39) 
with  an  acceleration  model  Eq.  (1.19).  A 50:50  attentlonal  split  between  in- 
formation pairs  was  assumed  for  azimuth  tracking  only.  The  relative  results 
were  much  the  same  as  for  the  steady-state  case;  tracking  errors  were  reduced 
by  almost  50Z.  Moreover,  the  structure  of  the  mean  error  response  changed 
significantly.  Now,  e(t)  resembled  the  target  jerk,  6.  This  result  remained 
true  — in  varying  degrees  — over  numerous  modeling  modifications  involving 

A 

estimation  of  z,  probaballatic  editing  schemes,  etc.  The  combination  of  small 
errors  with  a form  not  resembling  the  data  lead  us  to  conclude  that  acceleration 
cues  6 are  probably  not  provided  from  the  visual  image.  Indeed,  the  experimental 
results  of  e(t)  with  and  without  image  cues  are  structurally  similar,  with 
|e(t)|  being  somewhat  smaller  In  the  former  case. 

3.4.2  Potential  Use  of  Target  Velocity  Cues 

The  analysis  of  the  potential  use  of  6^  Information  followed  a process 
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similar  to  that  described  above.  Preliminary  steady-state  studies  showed 
that  optimizing  attention  allocation  of  (e,e)  vs.  0^  resulted  In  a 65:35% 
split.  However,  unlike  the  previous  case,  the  decrease  In  performance  cost 
(J)  was  less  than  5%  over  the  100:0%  case.  As  a result, use  of  6^  Information 
Is  expected  to  be  minimal  for  target  tracking.  Thus,  to  accentuate  any  effects 
introduced  by  0^,  we  will  assume  that  the  visual  cues  from  the  target  Image 
are  perceived  with  no  Interference. 

Using  a threshold  on  0^  of  3°,  the  OCM  predictions  of  tracking  error  have 
been  obtained  for: 

1.  Full  attention  to  azimuth  and  elevation  axes  (Figs.  31  and  32,  respec- 
tively). Straight-and-level  target. 

2.  Shared  attention,  straight-and-level  flyby 

3.  Shared  attention,  random  pitching  target. 

The  Inter-axls  attention  allocation  scheme  in  runs  2 and  3 used  p»2  as  described 
In  Section  3.3.  The  comparisons  between  Figs.  31-32  and  the  no-vlsual  cues 
casei  Figs.  20-21  show  that  6^  Information  has  little  effect,  as  anticipated. 
There  are  slight  decreases  in  |e(t)|  and  In  a^(t).  These  results  are  somewhat 
disappointing,  when  contrasted  with  the  corresponding  experimental  findings 
(Figs.  B7-8)  which  show  more  pronounced  visual  vs.  no-vlsual  differences. 

Similar  comparisons  have  been  found  for  the  two  dual-axis  tracking  cases. 

The  model  results  are  in  the  right  direction,  but  do  not  go  far  enough  in 
their  magnitude  decrease  for  e(t}.  It  appears  that  either  smaller  noise  ratios 
are  needed  on  0^  observations,  or  that  target  visual  cues  may  actually  affect 
the  error/error  rate  noise  ratios.  These  would  give  noticeably  smaller  model 
errors  for  |s(t}|  snd  o^(t). 

On  the  other  hand,  the  data  (Figs.  B9-12)  show  an  increase  in  o^(C)  over 
the  no  visual  cues  cases.  This  is  especially  true  for  the  random  pitching 
target.  It  appears  that  to  match  the  data  we  need  to  have  a threshold  on 
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error/error-rate  that  la  monotonlc  with  Image  size,  or  to  assume  that  the 

correlation  time  Increases.  Either  of  these  changes  would  have  a minor 

effect  on  e(t),  but  would  tend  to  Increase  o (t).  The  Idea  of  changing  thres- 

e 

holds  with  Image  size  has  been  used  successfully  at  AMRL,  and  appears  to  be 
a valid  model  modification  In  our  effort.  One  of  the  reasons  we  did  not  see 
any  differences  between  tracking  a fixed  size  triangle  and  tracking  a dot, 
was  that  we  placed  a zero-error  "dot"  Inside  the  trlange.  Apparently  It  was 
the  dot  that  the  subjects  tracked  and  not  the  Image.  In  the  visual  cues  case, 
the  "dot"  was  still  present  but  was  more  difficult  to  discern  possibly  because 
of  confusion  as  the  subjects  saw  the  target  roll,  pitch  and  yaw. 

The  experimental  mean  error  results  show  a trade-off  between  dual-axis 
attention  sharing,  and  the  use  of  a visual  Image.  Thus,  the  mean  errors  e(t) 
In  Figs.  B1  and  B2  compare  very  closely  with  their  counterparts  In  Figs. 
B9-B10. 
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IV.  CONCLUSIONS 

A combined  analytic-experimental  program  has  been  undertaken  to  examine, 
in  more  detail,  various  Issues  that  have  Impact  on  human  performance  in  target 
trecklng  tasks.  The  use  of  different  Internal  model  representations  has  been 
clarified,  along  with  a scheme  for  adaptation  of  the  Kalman  filter  pseudo- 
noise.  Different  assumptions  relative  to  target  visual  cues  and  Inter-axis 
attention  allocation  have  been  exercised  using  the  Optimal  Control  Model.  Data- 
model  comparisons  have  been  used  to  Isolate  correct  model  assumptions  and  hy- 
potheses. However,  not  all  of  the  originally  posed  questions  have  been  answered 
fully.  These  are  now  under  continuing  Investigation. 
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APPENDIX  A 

Mapping  a Three-Dimensional  World  onto  a 
Two-Dimensional  Viewing  Screen 

In  mapping  a target  (a  low-flying  aircraft.  In  our  case)  onto  a CRT  screen, 
the  basic  approach  Is  to  view  the  screen  as  a stol-transparent  "window"  between 
the  observer  and  the  target;  the  target  Image  on  the  screen  Is  then  the  observer- 
centered  projection  of  the  real  target  on  this  "window"  (see  Fig.  1). 


Figure  1 

It  is  not  necessary  that  the  "window"  be  planar;  as  a matter  of  fact.  In  our 
simulation  the  "window"  was  assumed  to  be  hemispherical,  to  simulate  the  effects 
of  the  observer's  head  motion  while  visually  following  a moving  target. 

The  position  of  the  projected  target  Image  on  the  screen,  d^.  Is  determined 
by  geometry  (see  Fig.  2). 

o - tg”^  ^ (A.l) 

-1  D' 

D“H'0*H'tg 


d^  - D - H • (-Y) 

-1  D’-d  • 
- D - H • tg  V'  l* 
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1.  Image  size  (see  Fig.  3): 

The  projected  Image  size,  I,  la  determined  from  the  target's  size,  L, 
as  follows:  . 


dl«t  - + (B’  - 4,')^  + (Altitude)^! 

-1  Vj 


6 ■ tg 


dlst 

-1  V2 
-1  V2 


2.  Image  Aspect  Ratio  (see  Fig.  4) 

The  projected  Image's  aspect  ratio  due  to  the  difference  In  elevation 
between  the  observer  and  the  target  Is  determined  by  the  elevation  angle  6 : 


d • tg 


-1 


[(Y^  + (D'  - d^')^j 


H 


3 .  Rotation 


In  general,  given  a point  (x  ,y  ,z  ) In  the  coordinate  system  (x,y,z), 

000 


its  coordinates  In  the  system  (X,Y,Z)  which  Is  rotated  with  respect  to  (x,y,z) 
will  be: 
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Figure  3 


diet  -Y  (Y/)^+(D'-d/)^  1 


Define  a coordinate  syatem  (X,Y,Z)  with  the  axes  (X,Z)  defining  a plane 
tangent  to  the  CRT  screen,  and  a second  coordinate  system  (x,y,z)  attached  to 
the  target  aircraft  (see  Figure  5).  The  systems  (X,Y,Z)  and  (x,y,z)  are  Inl- 
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tlally  parallel. 


Figure  5 


a.  Roll,  4:  The  aircraft  [and  Its  coordinates  (x,y,z)]  roll  around  the 
X axis.  The  rotation  matrix  R4  la  then: 


R4  ■ 0 cos4  sln4 

0 -sln4  cos4 


b.  Pitch,  6,  around  the  Y axis: 


cos  6 0 -sin  6 


sine  0 cose 


c.  Heading,  around  Z axis  (define  j(i^  * 0 along  X) . 


cost  -Sint 

tt  * "^nt  coat 


0 
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d.  The  tilt  6 due  to  the  difference  In  elevations  between  the  observer 
and  the  target  may  be  modeled  as  another  rotation  of  the  aircraft 
around  the  X axis,  after  Its  6 and  rotations: 


R 6 


10  0 
0 cos5  sln5 

0 -sln6  cos6 


and  the  coordinates  of  the  aircraft  In  the  CRT  coordinate  system  are: 


X 

X 

o 

o 
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- Rd  • ^ • R0  • R()) 
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o 

■ cos^  ’ coe0  • - (slnjl;^  • cos^  - cosj^  • slnd  ’ sln^)y^-(cos^  * slnS  ' 

cos^  slnj|«  sln^) 

■ (cos6  • slnO  - slnd  ‘ slnjjj^  • co86)x^  - (slnd  ' sln^  ■ sln0  * sln^  + 

slnd  * cos^  • cos^  + cosd  * cosO  • sln^)y^  + (slnd  • slnj(j^  ‘ sln0  ’ cos^  - 
Sind  ' cosj(^  ■ sln^  + cosd  ’ cos0  ’ coe^)z^ 


APPENDIX  B 


SUMMARY  OF  EXPERIMENTAL  ENSEMBLE  STATISTICS 
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